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(54) Parallel processor array and array element 

(57) A processor element (PE) for a parallel processor array comprises a memory 16, ALU 14, accumulator 12 and status 
register 20 for status or condition flags. This register is connected to an inactivity circuit 22 (Fig. 2) which includes an 
inactivity latch for each flag, forming a set (24 Fig. 2). The PE has a first port coupled to bus (64 Fig. 4) for instructions from 
the array controller which can render a PE inactive by setting a latch unconditionally or conditionally upon the status of the 
corresponding flag and which can reset a latch. When any latch is set, the PE does not execute normal instructions 
received from the controller on a second port. Because inactivity can be controlled conditionally on all status flags it is 
possible to implant various program constructs (IF THEN. ...ELSE; DO WHILE; etc.) as simply as in assembly language for 
a conventional serial processor with its own program counter, even although only the controller has such a counter, and 
such constructs are performed selectively by the PE's. The additional hardware complexity of each PE is small. 
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The drawing(s) originally filed was (were) informal and the print here reproduced is taken from a later filed formal copy. 
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PARALLEL PROCESSOR ARRAY AND ARRAY ELEMENT 

The present invention relates to the control of parallel 
processor arrays consisting of a plurality of individual processor 
elements. In particular, the invention is concerned with achieving 
local data-dependent control within each processor element (FE). 

In conventional single chip microprocessors, data-dependent 
control is achieved by means of BRANCH or JUMP instructions which 
are conditional on certain local conditions being met* An 
indication of the local condition is usually provided by a flag bit 
which is set or clear* The BRANCH or JUMP instructions are executed 
by the program sequencer part of the microprocessor which causes 
the program counter to be altered and, hence, the microprocessor to 
Jump to a different part of the instruction set forming the program. 

In single instruction, multiple data (SIMD) processor arrays, 
one instruction is sent by the controller to each of a number of 
processor elements forming the array. Each processor element 
executes the instruction on its own unique stream of data. Data- 
dependent conditions will inevitably differ in different processor 
elements and this fact makes control at a global level difficult, if 
not impossible, to achieve because a program branch address common 
to all processor elements does not exist. 

It is known to provide a processor element of an SIMD array 
with an activity control register storing a flag which may be set 
and reset to disable or "kill" the processor element and to 
reactivate the element. The setting and resetting takes place 
conditionally, but the system is no-where near as flexible in 
controlling program flow as branch and jump instructions in a serial 
(SISD) processor. 

The object of the present invention is to provide a processor 
element which can be used in an SIMD or other parallel processor 
array to render control as flexible and easy to use as the 
conditional statements in a conventional microprocessor. It is, 
however, essential that any control scheme provided for such an 
array should not rely on the program counter being altered as the 
processor elements in the array are not provided with individual 
program counters. 

Processor arrays achieve high data processing rates by 
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replicating many (e.g. 1024) identical processing elements. It is, 
therefore, also highly desirable to keep the complexity of each 
processor element as low as possible in order to avoid additional 
costs involved in replicating complex circuitry in each processor 
element. 

In accordance with the invention there is provided a processor 
element for a parallel processor array, comprising a plurality of 
inactivity latches corresponding to a plurality of condition flag6 
and each of which is settable and resettable in dependence upon the 
status of the corresponding condition flag, and serving, when set to 
disable activities of the processor element, and a control circuit 
responsive to received instructions in conjunction with condition 
flags of the processor element to set and reset the latches. 

Thus, in a processor array formed from such elements, the 
controller cycles through all possible instructions in 6trict 
sequence. The instructions must cover every possible condition 
which could arise in the processor elements of the array but each 
processor element discriminates, by reference to its inactivity 
latches, between those instructions which are to be executed on its 
own data and those intended for other processor elements of the 
array. 

The control scheme described above gives the flexibility of a 
conventional microprocessor utilising relatively simple circuitry 
in the individual processor elements so that hardware costs are kept 
to a minimum and use of resources is maximised. It further allows 
each processor element in a SIMD processor array to make 
conditional forward f branch' operations on the basis of conditions 
generated locally, because the instructions up until the relevant 
label are ignored. Such 'branch* operations appear to the user to 
be analogous to conditional instructions in a conventional single 
chip microprocessor. 

The invention will now be described in more detail, by way of 
example, with reference to the drawings, in which: 

Fig. 1 is a block diagram of a processor element embodying 
the invention, 

Fig. 2 illustrates an inactivity circuit of the processor 
element in detail, 



Fig, 3 shows the circuit of a single inactivity bit latch, and 
Fig, A is a block diagram of an SIMD processor array embodying 
the invention* 

A conventional microprocessor incorporates an arithmetic and 
logic unit (ALU) and a program sequencer. The sequencer allows 
conditional branching and loops to be performed by altering the 
program counter, as mentioned above. In a SIMD array, the only 
program counter is that in the main controller and, consequently 
conditions! JUMP and CALL instructions, which cause the program 
sequencer to skip to an entirely different program address, are not 
possible* In any event, conditions vary from one part of the array 
to another, so that evaluation of a given condition will vary from 
one processor element to another. Each processor element must, 
therefore, be provided with means by which local conditional 
statements can be evaluated without reference to a central program 
counter. 

The processor element shown in Fig. 1 is based on a 
conventional 8 bit accumulator architecture and includes an 
accumulator 12, an ALU 14, a memory 16 and an address register 18. 
The ALU permits ADD, SUB, AND, OR, COMPARE and EOR operations 
between the memory 16 and the accumulator 12. Operations which can 
be performed on the address register 18 are INC and DEC. The 
address can be set from the accumulator 12 or from the array's 
central controller. The central controller broadcasts the same 
instruction to all the processor elements of the array and supplies 
a common 8-bit literal field. The processor element does not 
include a conventional set of registers but a status register 20 is 
provided for a set of eight states or condition flags. 

As thus far described, there are no differences between the 
processor element shown and a conventional microprocessor. The 
processor element is, however, additionally provided with an 
inactivity control circuit 22, including a set of eight single bit 
local inactivity latches 2k (Fig. 2). Fig. 2 also shows the status 
register 20 and circuitry, described below, enabling the latches 24 
to be individually set and reset. The outputs of the latches are 
combined in an OR gate 26 whose output 28 is an inactivity control 
line. When any one or more of the latches 24 is set and the line 
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28 i6 high, the processor element is disabled from implementing 
instructions, e.g. by disabling storage elements within the 
processor element. Disabling is also referred to herein as "killing". 

The flags and latch bits listed in Table 1 below comprise both 
conventional and novel conditions. 

Table" 1 



Condition 


Flag 


Latch" Bit 


Zero 


Z 


lz 


Negative 


N 


In 


Carry 


C 


1c 


Overflow 


V 


lv 


Global 


G 


lg 


Sticky 


S 


Is" 


User Zero 


0 


10 


User One 


1 


11 



The global condition is explained below. The sticky flag, once 
set to logical 1, will remain set until an explicit "clear flag" 
instruction is performed by the processor element. This operation 
is useful when performing normalizing functions on floating point 
mantis6ae. The two user flag6 are provided to allow the user to 
implement further logical functions without being tied to in-built 
conditions such as zero, negative, carry and overflow. These user 
flags are optional but may be provided up to the limit set by the 
number of control lines from the controller to the processor 
elements. 

Reverting to Fig.2, the latch bits are set and reset under the 
control of a condition (positive or negative) line 30, an 
unconditional KILL line 32, an inverted REACTIVATE line 34 and an 8-* 
bit latch select bu6 36. The signals on these lines are determined 
by 10-bit kill /reactivate fields broadcast to the processor 
elements by the controller and comprising a two-bit operation code 
and an 8-bit latch select code. The operation codes are set out 
in Table 2, which also shows the decoding to the lines 30, 32 and 
34. 
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Table' 2 

Operation Code Condition* Kill' Reactivate- 

Line Line 

Kill unconditionally 00 X 10 
Kill on positive 

condition 01 1 0 0 
Kill on negative 

condition 10 0 0 0 

Reactivate 11 X X 1 

X means "don't care". 

If the code is 11 and reactivate is true, the inverted 
reactivate line 3A is false and the outputs of all of eight AND 
gates 40 are false. These false outputs reset those of the 
latches 24 whose latch select lines 36 are high, as will be 
explained with reference to Fig. 3. 

If the code is 00 the kill line 32 is high and the outputs of 
eight OR gates 42 will be high. Since the inverted reactivate line 
34 is also high (Table 2), the outputs of the AND gates 40 are true 
and set those of the latches 24 who latch select lines 36 are high. 

If the code is 01 or 10, the outputs of some of a set of eight 
exclusive NOR gates 44 will be high, depending upon the states of 
the flags in the register 20. The outputs of only the 
corresponding AND gates 40 will be true and a true output will set 
the corresponding latch if its latch select line 36 is high. 

The circuit of a 6ingle latch is shown in Fig.3 and comprises a 
D-type flip-flop 46 with its D input connected to the output of the 
corresponding AND gate 40. The flip-flop is clocked on a positive- 
going edge on its CK terminal. A clock signal 48 is passed by an 
AND gate 50 when reactivate is true and is passed to the CK terminal 
by an AND gate 52 only if the corresponding latch select line 36 is 
true. Accordingly, a processor element will be reactivated at the 
start of an instruction cycle, in response to the leading edge 54 of 
the clock signal 48. The inverted clock signal 48 is passed by an 
AND gate 56 when reactivate is false and is passed to the CK 
terminal by the AND gate 52 only if the corresponding latch select 



- 6 - 



line 36 is true. Accordingly, a processor element vill be killed 
on the falling edge 58 at the end of the first phase of the clock 
cycle. 

The effect of this is that a processor element (FE) vill always 
execute an instruction which is broadcast in parallel with a kill or 
reactive instruction which takes effect on that element. 

The latch select lines 36 directly copy the 8-bit latch select 
code* Fig.4 illustrates a fragment of an array processor comprising 
a controller 60 and a plurality of processor elements 62 to which 
the controller 60 broadcasts the. above-described 10-bit 
kill/reactivate fields on a bus 64 and the 10-bit operation codes, on a 
bus 66 , for the other processing operations. In a practical 
embodiment there may be 1024 processor elements. 

The processor element thu& has separate ports for the 
kill/reactivate fields and the normal operation codes, so that 
kill /reactivate instructions can be broadcast in parallel with 
normal operation codes. When a FE is rendered inactive, it i6 
disabled as a processing entity, that is to say it is not 
influenced by instructions received on its normal opcode port, but 
the circuitry (Fig;2) on the bill /reactivate port remains 
functional. 

The processor element described above can be controlled by 10- 
bit fields corresponding to the following assembly language kill 
instructions in Tables 4 to 6. 



Table' 4 

"Branch' on* Positive' Conditions 



KZS 


LABEL 


Deactivate if zero flag set 


KCS 


LABEL 


Deactivate if carry flag Bet 


KMI 


LABEL 


Deactivate if negative flag set 


KVS 


LABEL 


Deactivate if overflow flag 6et 


KGS 


LABEL 


Deactivate if global flag set 


KSS 


LABEL 


Deactivate if sticky flag set 


KOS 


LABEL 


Deactivate if first user flag set 


K1S 


LABEL 


Deactivate if second user flag set 



m 

KCC 

m 

KVC 
KGC 
KSC 
KDC 
K1C 



Table' 5 

"Branch'on* Negative" Conditions 



LABEL 
LABEL 
LABEL 
LABEL 
LABEL 
LABEL 
LABEL 
LABEL 



Deactivate if zero flag not set 
Deactivate if carry flag not set 
Deactivate if negative flag not set 
Deactivate if overflow flag not set 
Deactivate if global flag not set 
Deactivate if sticky flag not set 
Deactivate if first user flag not set 
Deactivate if second user flag not set 



Table' 6 
Unconditional' "Branches" 



KKZ 
KKC 
KKN 
KKV 
KKG 
KKS 
KKO 
KK1 



LABEL 
LABEL 
LABEL 
LABEL 
LABEL 
LABEL 
LABEL 
LABEL 



Set zero latch bit lz 
Set carry latch bit lc 
Set negative latch bit In 
Set overflow latch bit Iv 
Set global latch bit Ig 
Set sticky latch bit Is 
Set first user latch bit 10 
Set second user latch bit 11 
and Fig. 2. 



From Tables 2 and 4 and Fig.2 it can be seen, that the 
kill/reactivate field for KVS will be 

0100100000 
since the most significant bits 01 identify the operation "kill on 
positive condition" and the sixth least significant bit identifies 
the overflow latch (Fig.2). 

All the assembler instructions in Tables 4, 5 and 6 include 
LABEL. This label is not passed to the processor elements. The 
controller 60 automatically generates the appropriate reactivate 
command when it reaches the label. Those commands are given 
in Table 7, although they are never coded by the programmer, and 
they complement the unconditional kill commands of Table 6. 





— ft — 




Table' 7 




Reactivate' Command 6 


RRZ 


Reset zero latch bit lz 


RRC 


Reset carry latch bit lc 


RAN 


Reset negative latch bit In 


RRV 


Reset global latch bit lg 


RRS 


Reset sticky latch bit Is 


RRO 


Reset first user latch bit 10 


RR1 


Reset second user latch bit 11 



The use of these instructions will now be clarified by looking 
at some examples: 



Example " 1 



1) 
2) 
3) 



LDA 
ADD 
KZS 



Y 
£5 
LABEL 



A) 
5) 
6) 

7) LABEL ... 

8) . 



do something 

Kill operation if zero flag i6 set 
until LABEL reached 
Section of code 



; PEs are reactivated by RRZ and this 
; instruction is executed 



In example 1, all processing elements with their zero flags set 
at line 3 are disabled until line 7. At line 7 the PEs are 
reactivated in parallel with the instruction on that line and the 
instruction on line 7 is executed* The label specified on line 3 
may be used by more than one Kill instruction. When the label is 
reached, all the PEs deactivated with reference to this label will 
be simultaneously reactivated. Note that the instruction RRZ to do 
this i6 inserted in the object code automatically by the assembler. 

Processing elements may be disabled at different places by the 
SAME condition! but will always be reactivated at the same point, *s 
in the next example. 
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Example* 2 



1) 
2) 
3) 
4) 
5) 
6) 

7) LABEL ... 
8) 



KZS 



KZS 



LABEL 



LABEL 



Although Example 2 is legal, some combinations of deactivation 
and reactivation are not aJL lowed. Here are two examples of illegal 
constructs : 

The assembler will not allow a program to 'leap frog 1 on the SAME 
condition as shown in the next example. 



1) 
2) 
3) 
4) 
5) 
6) 

7) LABEL 1 ... 



8) 

9) LABEL 2 ... 



Example* 3 



KZS LABEL 1 



KZS LABEL 2 



; Reactivated here but this code 
; section is still dependent on 
;condition in line 5. 



Nested deactivation on the SAKE condition is also not allowed. 



- 10 - 



Example* 4 

1) 

2) KZS LABEL 1 

3) 

4) 

5) KZS LABEL 2 

6) 

7) LABEL 2 ... ; Reactivated here but this code 

; section is still dependent on 
; condition in line 2. 

8) 

9) LABEL 1 ... 

'Leap frogging 1 and nested deactivation is possible if DIFFERENT 
conditions are used or if the condition is transferred to a 
different register in order to do the deactivation. Example 5 
shows legal f leap frogging 1 using zero and carry flags while Example 
6 shows legal 'leap frogging 1 on a single condition (zero flag). 

Example" 5 

LABEL 1 



LABEL 2 



1) 

2) KZS 
3) 
4) 

5) KCS 
6) 

7) LABEL 1 
8) 

9) LABEL 2 ... 



Example 6 

1) 

2) KZS LABEL 1 

3) 

4) move Z to C 

5) KCS LABEL 2 
6) 

7) LABEL 1 ... 

8) ... 

9) LABEL 2 ... 

Although legal, examples 5 and 6 are not recommended as good 
programming practice. 

Example 7 shows how a locally controlled IF THEN ELSE can be 
implemented. The construct required is: 

IF accumulator -0 THEN 
begin 

list of instructions 

end 

ELSE 

begin 

list of instructions 

end 

In assembler this becomes: 

Example' 7 

;2ero flag set on the accumulator being loaded. 
KNZ ELSE ;If 2ero flag not set, then turn off PE whilst 
;the THEN statements are being executed 
; Begin THEN instructions 

. • • 

;Last 'THEN' statement 
KKO END ;Jump to end of else statements. 

Unconditional deactivation using the 1st userflag. 
;This deactivation is however activity controlled. 
;If the zero flag was not set previously then this 
; instruction i6 not performed. 
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ELSE ... ; Start of ELSE statements 

• • • 

• « • 

END ;Lafit 'ELSE' statement 

;A11 reactivation is done in parallel with this 
instruction. 

A WHILE construct is slightly more complex than the IF THEN 
ELSE. This ie because the number of loops performed in WHILE 
construct is locally contrtolled but the controller oust be aware 
when all the loops being executed locally are complete. 

There are two ways of doing this. The first is to specify in 
code the maximum number of times the controller loops through the 
section of code where the WHILE construct is defined. After each 
iteration the processors that have satisfied the WHILE condition are 
disabled. The number of loops specified to the controller must be 
enough to allow all local conditions to be satisfied. 

The second method does a global 'IF ANY 1 operation after each 
iteration. The controller checks a single bit that comes from the 
array. This bit is called the 'GLOBAL BIT' and is hardwired OR of 
all the global latch bits output by the FEs. The controller can . 
then act conditionally on this bit. Examples of each method are 
given in Examples 8 and 9 respectively. The indented instructions 
in these examples refer to the array of FEs and the outer 
instructions are controller instructions* No instruction which 
relies on the program counter being altered, such as a FOR or BRANCH 
instruction, can be executed by the array, a6 previously explained. 

The generation of GLOBAL BIT 68 is illustrated in Fig.4. OR 
gate6 70 are used to represent the wired OR function which is 
performed on all global latch bits lg as output from the individual 
FE's. 

We want to execute the following construct locally: 
WHILE accumulator - 0 
DO 

Begin 

List of Instructions 

End 
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Example 8 

FOR MAX ; start of controller loop 

KNZ END ;If the accumulator is not zero then kill 

;any activity until the end 
; Instructions that are to be performed within 
;the WHILE loop 

• • • 

• • • 

NEXT ;end of controller loop 

END 

• • * 

Example' 9 

SET GLOBAL; Controller explicitly sets all global flags* 
WHILE global bit TRUE; Controller construct, 

begin 

KNZ END ; condition tested at start of loop 

... ;do the instructions with the white loop 

;end of loop condition evaluated 

• ;e.g. Z flag false 

;move Z flag to global flag 
;this may need more than one instruction 
end ;end of the loop (may need more than one 

instruction) 

;to allow for propagation 
END • •• {Reactivation here 

• • • 

Both the above implementation of the local condition WHILE loop 
have their advantages and disadvantages* The first method is better 
if MAX is not very great or if MAX normally occurs anyway. The 
disadvantage is that MAX must be finite and must be known at 
assembly time. 

In the second method MAX does not have to be known and the loop 
will terminate as soon as all the FEs are finished* The looping 
overhead in the second method is, however, greater because the 
condition bit must first be moved to the global latch and then a 
cycle must be allowed for the contents of the global latch bits to 
propagate out so a6 to form the new global bit for the controller to 



test at the start of the loop. 

The global flag can be thought of as a special example of a 
user flag, with the difference that the global latch bit are OKM 
to form the global bit back to the controller. 

To perform a DO WHILE construct the flag test is 6imply made 
the last instruction in the loop, hence ensuring the instructions in 
the loop are executed at least once. 

With the IF THEN ELSE and WHILE loop illustrated above, any 
local construct can be implemented, 
eg. 

FOR: for i - 1 to 100 do 

begin 
... 
• * • 

end 



becomes 

i - 1 

while i « 100 do 
begin 



i ■= i + 1 
end 



REPEAT UNTIL: 

repeat 



until x true 

becomes 

do 



» • 



while x true 
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CASE 



case x of 

1 : ....< 

2 : ..... 

3 : 

4 : ....< 
otherwise : 

end 



becomes 



if x - 1 then statements, 6et flag 

if x B 2 then statements, set flag 

if x « 3 tjien statements, set flag 

if x - 4 then statements, set flag 

if flag not set then 

Note, however, in a sequential machine the machine can ignore 
the rest of the case statement as soon as a true condition is found. 
For this reason it is not efficient to implement the CASE construct 
as a series of IF statements in a sequential machine. In a SIMD 
machine, however, all the conditions MUST be evaluated because 
different cases will be found across the array. Premature 
termination of the case statement in a SIMD array i6 only possible 
if the flag which i6 set in each IF statement in the example above, 
is inverted and placed in the global bit register. The global bit 
will then inform the controller if there are 'ANY 1 cases still to be 
resolved. In all cases involving global control, it is only if the 
amount of conditional processing is large that a check on the global 
bit should be made. 

Conditional CALL instructions may be done by disabling all the 
processing elements not wishing to execute the subroutine, before 
the microcontroller vectors to the new location in program memory. 
The programmer does, however, HAVE to be aware of which inactivity 
registers are used within the subroutine so that the same 
inactivity registers are not used to disable FE's prior to 
subroutine entry. This problem can be avoided by observing a 
simple rule on inactivity register usage, Thi6 might be that 
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subroutines are only permitted to use ALU FLAG inactivity registers; * 

while the program uses only USER FLAG inactivity registers to 

control conditional execution of subroutines. « 

The status or condition flags of the register 20 may be 
manipulated as veil S6 set or reset in dependence upon the outcome 
of operations. The instruction to manipulate the flag6 can be 
INVERT, SET, RESET and normal shift operations. Individual bits 
in the accumulator 12 can be transferred to specified flags. 

As well as the simple operations set out in Tables 4 to 7 it 
is possible to code multiple operations whereby a plurality of 
latch bits are set or reset simultaneously, i.e. by 
including more than one set bit in the 8-bit latch selection 
field. If all eight bits are set, for example, it will be 
possible to effect global reactivation,, i.e. clear all latch bits 
by broadcasting the kill/reactivate field 
1111111111. 

The embodiment of the processor element described above i6 
based upon a conventional 8-bit, memory reference architecture. 
The invention is clearly not restricted to such an implementation. 
Different word sizes and/or architectures may be employed. 



CLAIMS: 



1* A processor element for a parallel processor array, comprising 
a plurality of Inactivity latches corresponding to a plurality of 
condition flags and each of which is eettable and re6ettable in 
dependence upon the status of the corresponding condition flag, and 
serving, when set to disable activities of the processor element, 
and a control circuit responsive to received instructions in 
conjunction with condition flags of the processor element to set and 
reset the latches* 

2. A processor element according to claim 1, comprising means 
forming a disabling signal for the preocessor element as an OR 
function of the states of the inactivity latches* 

3. A processor element according to claim 1 or 2, comprising at 
least one inactivity latch corresponding to a user flag whose 
status is settable by the user under program control. 

4. A processor element according to claim 1, 2 or 3, comprising a 
first port for the aforesaid instructions and a second port for 
other instructions, the said control circuit being connected to the 
first port and remaining active when activities of the processor 
element are disabled, whereas the processor element is not 
influenced by instructions received on the second port when 
activities of the processor element are disabled* 

5* A processor element according to claim 4, wherein each 
inactivity latch is reset at an early time in an instruction 
cycle, in response to one of the first said instructions, and is 
set at a later time in an instruction cycle, in response to one of 
the first said instructions, whereby the processor element will 
execute one of the said other instructions received on its second 
port simultaneously with any first 6 aid instruction on the first 
port whose effect is either to set any one or more of the inactivity 
latches or to reset every one or more of the inactivity latches which 
were in their set state* 
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6. A processor element according to claim 1 and substantially as 
hereinbefore described and as illustrated In Pigs. 1 to 3 of the * 
accompanying drawings. 

7. A parallel processor array comprising a plurality of processor 
elements according to any of claims 1 to 6 and a controller adapted to 
broadcast to the elements both first instructions for setting and 
resetting the inactivity latches of the processor elements and other 
instructions. 

8. A parallel processor array according to claim 7; wherein the 
controller is connected to the processor elements for simultaneously 
broadcasting one of the firBt instructions and one of the other 
instructions. 

9. A parallel processor array according to claim 7 or 8 f wherein 
one inactivity latch of each processor element is connected to an OR 
circuit returning a global signal to the controller.- 
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